Long-time memory in non-Markovian evolutions 
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If the dynamics of an open quantum systems is non-Markovian, its asymptotic state strongly 
depends on the initial conditions, even if the dynamics possesses an invariant state. This is the very 
essence of memory effects. In particular, the asymptotic state can remember and partially preserve 
its initial entanglement. Interestingly, even if the non-Markovian evolution relaxes to an equilibrium 
state, this state needs not be invariant. Therefore, the non-invariance of equilibrium becomes a clear 
sign of non-Markovianity. 
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I. INTRODUCTION 

Open quantum systems and their dynamical features 
are attracting increasing attention, nowadays. Their in- 
terest is twofold. On one hand, they are of tantamount 
importance in the study of the interaction between a 
quantum system and its environment, causing dissipa- 
tion, decay and decoherence [l|, [I]- On the other hand, 
the robustness of quantum coherence and entanglement 
against the detrimental effects of the environment is one 
of the major scopes in quantum enhanced applications, 
as both entanglement and quantum coherence are basic 
resources in modern quantum technologies, such as quan- 
tum communication, cryptography and computation Q . 

The detailed characteristics of the dynamical evolution 
are far from being obvious and are often quite surpris- 
ing. For example, while the coherence of single qubits in 
Markovian environments decays exponentially, the evo- 
lution of the entanglement between two qubits markedly 
differs and may completely disappear at a finite time 
(and eventually revive later) a phenomenon known 
as "entanglement sudden death," that has been recently 
experimentally demonstrated |5| and analyzed from dif- 
ferent perspectives @. 

In this paper we will focus on non-Markovian evolu- 
tions and will show that they define a completely new 
kind of quantum dynamics. In particular this leads to 
the modification of the characteristic exponential relax- 
ation law known from Markovian evolutions. Interest- 
ingly, we will show that even if the non-Markovian evo- 
lution relaxes to an equilibrium state this state needs 
not be invariant. This can never happen in the Marko- 
vian case. Therefore, the non-invariance of equilibrium 
becomes a clear sign of non-Markovianity. It turns out 
that the asymptotic state of the system depends on the 
initial conditions, even if the non-Markovian dynamics 
possesses an invariant state. For composed systems this 
implies that the asymptotic states can remember (and 
partially preserve) its initial entanglement. These con- 
clusions will be illustrated by several examples and pave 



the way towards a more general comprehension and prac- 
tical exploitation of non Markovian evolutions. 



II. PRELIMINARY IDEAS 

A. Non-Markovian dynamics 

The usual approach to the dynamics of an open quan- 
tum system consists in applying the Markovian approxi- 
mation, that leads to the following local master equation 



Pt= Lpt , 



(1) 



where pt is the density matrix of the system investigated 
and L the time-independent generator of the dynamical 
semigroup. This can be formally solved 



Pt 



At/9 (i > 0, p = pt^o) 



(2) 



and it is well known that under certain conditions on 
L the dynamics At is completely positive and trace 
preserving [2, Q . 

Let us study the behavior of quantum coherence under 
non-Markovian evolutions. For the sake of simplicity, we 
shall restrict our attention to finite level systems. A pop- 
ular non-Markovian generalization of ([1]) is the following 
nonlocal equation 



Pt 



Lt-T Pt dr 



(3) 



in which quantum memory effects are taken into account 
through the introduction of the memory kernel L^'. this 
simply means that the rate of change of the state pt 
at time t depends on its history (starting at t = 0). 
The Markovian master equation ^ is reobtained when 
Lt = 25{t)L. The time dependent kernel is usually 
referred to as the generator of the non-Markovian master 
equation. Equation ([3]) applies to a variety of situations, 
e.g. when the particle is born in the medium in which 
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it propagates (neutrinos in a stellar medium Q or pairs 
of neutral kaons in the gravitation field of a laboratory 

One of the fundamental problems in the theory of non- 
Markovian master equations is to find those conditions 
on Lr that ensure that the time evolution resulting from 

m 



p 



pt = Mp 



(4) 



is completely positive (CP) and trace preserving [ll| - |l8l [. 
Let us observe that this problem may be reformulated as 
follows [l^: any completely positive solution At of Eq. 
([3]) may be represented by 



At = 1- 



<1>^ dr 



(5) 



where the maps $t satisfy Tr^^P = for all p. This 
condition guaranties that At is trace preserving. It is 
easy to show that the Laplace transform of the generator 
Lr of the non-Markovian master equation ([3|) is related 
to the Laplace transform of $r as follows 



(6) 



Now, in order to explicitly write down Lr one has to 
invert the Laplace transform Ls- Note, however, that this 
might be very hard, due to the fact that Lg is a highly 
nontrivial function of s (possessing in general not only 
poles but also cuts in the complex s-plane) . It is therefore 
clear that even if one knows the solution pt = Afp, it is 
in general very difficult (if not practically impossible) to 
write down the corresponding non-Markovian equation 
([3]). On the other hand, the knowledge of the (trace 
preserving and CP) solution At enables one to no longer 
care about the underlying equation! Let us look at an 
interesting example. 



B. An example 

The previous comments are best understood by looking 
at an example. Consider the pure decoherence model, 

H = Hn + Hs + HsR. (7) 

where He. is the reservoir Hamiltonian, 

^s=$]enP„ {Pn^\n){n\) (8) 



the system Hamiltonian and 

HsR = ^Pn® B„ 



(9) 



the interaction part, respectively, i?„ = B^^ being reser- 
voirs operators. The initial product state p ® ujr evolves 



according to the unitary evolution e~*^* (p ujuje''^^ and 
by partial tracing with respect to the reservoir degrees of 
freedom one finds for the evolved system density matrix 



Pt 



where 



Trfl[e 



-iHt 



{p®u)R)e 



■Hti 



n,rrt 



{t)P,npPn 



(10) 



c„^„(t) =Tr(e-*^"*L.fle*^"*), (11) 
and the reservoir operators Z„ are defined by 

Zn^enlR + HR + Bn. (12) 

Note that the matrix c„m {t) is semi-positive definite and 
hence Eq. pO)) defines the Kraus-Stinespring representa- 
tion [lOl of the completely positive map At 



AtP = ^ C,n7i{t)P,nPPn 



The prescription ([5]) yields 



(13) 



Pt^P+ ardr , (14) 
Jq 

ar = $r/5 = = ^ CmniT)P,npPn (15) 



and one very easily shows that TrtTT- — 0. The solution 
of the pure decoherence model can therefore be found 
without explicitly writing down the underlying master 
equation. What is (and needs to be) known is that pt 
satisfies the non-Markovian master equation ([3]), but the 
construction of the corresponding memory kernel Lt is 
too formidable a task. Indeed, let us observe that due to 
the following spectral property of Af 



At\m){n\ = Crnn{t)\m){n\ 



(16) 



one obtains the following formula for the corresponding 
generator 



LtP = ^ K.mn{t)PmpPn 



(17) 



where the functions K.mn{t) are defined in terms of their 
Laplace transform as follows 



^rnn (^) 



(18) 



Note, that c„i,n{t) — 1, and hence Kmm(^) ~ 0. This 
condition guaranties that ifl = 0. However, the calcula- 
tion of the off-diagonal elements Kmn{t) is in general not 
feasible. 

Many similar examples are known in the physical lit- 
erature, e.g. in connection with the quantum Zeno effect. 
See [2l| for a review on non Markovian decay and [22| for 
its experimental observation. In the following we shall 
therefore work directly with At and Eqs. ©-(in]), without 
detailing the features of the appropriate memory kernel 
Lt. 
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III. ASYMPTOTIC VS EQUILIBRIUM STATES 

Let us now point out the crucial difference between 
Markovian and non-Markovian evolutions. Recall that 
a state w is an equilibrium state for the (Markovian or 
non-Markovian) evolution At if 



lim Ktp — ui \/p. 



(19) 



One says that the evolution relaxes to w and we shall 
assume for simplicity that uj is unique for the given Aj. 
On the other hand a state po is an invariant state for Kt 
if 



Atpo = Po Vt > 



(20) 



Note that if At defines a semigroup, i.e. At = e*^, then 
Po is invariant if Lpo ~ 0. Clearly, for Markovian evolu- 
tion the equilibrium state u) is always invariant. This is 
a straightforward consequence of the semigroup property 
A5_|_t(w) = Kt{Ks{ui)) in the limit s oo. However, this 
property is no longer true in the non-Markovian case, 
where the semigroup property cannot be used. There- 
fore, one may have non-Markovian evolutions relaxing to 
an asymptotic equilibrium state which is not invariant. 
In the following, we shall analyze a few situations in or- 
der to explore the relaxing properties of non-Markovian 
evolutions. 



A. A case study: convex combination of Markovian 
semigroups 

Let Li,...,L„ be a set of generators of Markovian 
equations of the type ([1]) and let (pi, . . . ,p„) be a prob- 
ability distribution (X^Pfe — !)• Then 



^tLk 



(21) 



k=l 



is by construction completely positive and satisfies ^ 
with 



rfAt 
dt 



k=l 



Pk Lkc 



tLk 



(22) 



Actually, it is not difficult to conceive an evolution that 
is a convex combination of Markovian semigroups. Con- 
sider a system S living in "Hs coupled to a reservoir R liv- 
ing in T-Lr- (Actually, one may consider an arbitrary num- 
ber N of reservoirs. In this case T-L^ = Hi <8) ■ ■ ■ (8) Hat.) 
Now, couple the composed S-R system to an n-level an- 
cilla living in C" and assume that the Hamiltonian has 
the following form 



H 



Y.Hk^ 



>Pk 



(23) 



where Pk = \k){k\ {\k) is an orthonormal basis in the an- 
cilla Hilbert space C") and 
The unitary evolution generated by reads 



hI are S-R operators. 



itH ^ ^ p-itHk 



e = 2^e 

k=l 



^Pk, 



(24) 



hence if the initial product state is p^bJR^a, a being 
a state of the ancilla, the reduced dynamics yields the 
following evolution for the system density operator 



(25) 



k=l 



where pk = {k\a\k). Standard weak coupling arguments 
lead to (PT|) . 

A convex combination (j2ip of Markovian semigroups 
is no longer a semigroup and satisfies the non-Markovian 
master equation ([3]). However, it can be very compli- 
cated to find the corresponding memory kernel. Observe 
that if for each k the corresponding Markovian evolution 
K^^^ = e*^'' possesses a unique equilibrium (and hence in- 
variant) state Wfe, then At defined by (PT|) relaxes to the 
equilibrium state lo = X]fe=i Pk^k- Note that need not 
be invariant for Aj'^ with I ^ k {li is invariant if Li and 
commute) . We stress that if each subgroup of ensemble 
members has its own Markovian decay process, towards 
its own equilibrium, then the global (non-Markovian) dy- 
namics has a well defined equilibrium (convex combina- 
tion of Markovian equilibria) and hence the final state 
does not depend on the initial state (by definition of equi- 
librium). However, the equilibrium state lo needs not be 
invariant for the non-Markovian evolution governed by 
(pi]) . That is, in general Afo; ^ oj, but of course asymp- 
totically limt_i.oo Atw — Lo. 

The simplest example of (PT|) corresponds to Li = L 
and L2 = 0, yielding the following non-Markovian evolu- 
tion 



At = (l-p)e*^+p]l, 



(26) 



i.e. a mixture of a semigroup dynamics e*^ and the triv- 
ial one Hp — p. Equations (O-® yield 



Ls = {l-p)L 



p{l-p)L^ 



(27) 



k=l 



s-{l~p)L ' 

which can be easily inverted 

Lt = 2(1 - p)6{t)L + p{l - p)L^e^^~P^^ . (28) 

Note the similarity with the Shabani-Lidar [l^ memory 
kernel Lt = Le*^ of the post-Markovian quantum master 
equation. In general Le*^ does not lead to a completely 
positive dynamics. On the other hand, the kernel ((28)) 
generates a completely positive dynamics for arbitrary 
L. Formula (|26p is an exceptional case: in general one 
cannot obtain a closed expression for the generator Lf. 
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We stress that the non-Markovian dynamics (pG]) displays 
very pecuhar features. Suppose that e*^ possesses an 
equihbrium (and hence invariant) state cj. It is clear 
that w is still invariant for (|26p but it is no longer an 
equilibrium state. Note, that LfUJ = due to the fact 
that Luj = 0. In conclusion, one has 



lim Atp = (1 - p)uj + pp, 



(29) 



which shows that uj cannot be reached asymptotically 
(unless we start with u itself). Since, in general, a non- 
Markovian evolution is not relaxing, the asymptotic state 
strongly depends on the initial condition. This is the very 
essence of memory effects — the system remembers its ini- 
tial state. We stress that this result is model indepen- 
dent. The only assumption is that L generates a relaxing 
Markovian semigroup. For example one may take instead 
of the trivial generator L2 = the following one 



where 



4 = -7(1-^), 7>0, 



(30) 



(31) 



is a projector, with P„ = |n)(n|, |n) being eigenvectors 
of Lo. One has therefore Vu) = w. Hence, the convex 
combination ((2T|) yields the following formula 



a; = (1 - p)e}^ +pV + e-'^t - V) 



(32) 



For 7 = 0, L2 = ^2 and one recovers 
asymptotic formula is replaced by 



For 7 > the 



lim Ajp = (1 — p)uj + pV p. 



(33) 



Again, w defines an invariant state for AJ. However, AJ is 
not relaxing and oj is not reachable (unless we start from 
it). Observe that the mixing parameter p £ [0, 1] in ([25)1 
and ([5^ measures in a sense the "non-Markovianity" of 
the evolution. 



B. Quantum channel 

We now look at a different example. Let 

Lt = i^it) (S - 1) , (34) 

where B is a quantum channel (i.e., a trace preserving 
CP map) [13, [11, • generates a completely positive 
trace preserving dynamics At if the Laplace transform 
k(s) satisfies 



k{s) 



(35) 



where f{t) > and f{T)dT < 1 . Note that the cor- 
responding Laplace transform of At reads 



A, 



1 



(36) 



and in general cannot be inverted. However, even if we 
are not able to find At, we can easily study its asymptotic 
behavior. Indeed, using the well known property of the 
Laplace transform 



lim At = lim sA, 



(37) 



if all poles of sAs are in the left-hand plane, one obtains 
from p6|) the general asymptotic formula 



A, 



1 ~ /(O) 
1-/(0)5 



(38) 



To study Aoo in more detail consider the spectral decom- 
position of B: 

Bp^Y. bcFMGip) , (39) 

where d stands for the dimension of the system Hilbert 
space, and F„ and Ga define the bi-orthogonal damping 
basis of B. Suppose now that B possesses the unique 
invariant state po- This implies i^g = Poi Cg = I and the 
corresponding eigenvalue = 1. One has therefore 



Let us observe that if 



F^T^iGlp) . (40) 



/(O) = / .f{T)dT = 1, 



(41) 



then Aoop = pQ, that is, the non-Markovian dynamics 
At is relaxing to the asymptotic equilibrium state po- 
However, if /(O) < 1, then the dynamics is no longer 
relaxing and the asymptotic state AqoP remembers about 
the initial state p. 

Consider for example /(t) — £76"''"^, with 7 > and 
e e (0, 1]. One has in this case 



/(0)=£<1, 



(42) 



and hence the parameter e controls the asymptotic state 
AooP. Let us observe that one can easily invert the 
Laplace transform ([55]) to obtain the following expres- 
sion for the function nit): 



Hi{t) = £7 \2S{t) - 7(1 - e)e-^(i-'^)^ 



(43) 



Observe that for e = 1, one gets K{t) ~ '2'-fS{t) which cor- 
responds to the Markovian dynamics. Hence, the param- 
eter 1 — s measures the deviation from the Markovianity. 
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This shows that non-Markovian evolutions are much 
more flexible. One can control the asymptotic behavior 
by controlling a single function of time f(t) (for example 
by controlling a single parameter e). Note that in the 
Markovian case the evolution generated by p4| is given 
by 

Arp = ^e^^°*F„Tr(Glp), (44) 

a 

and hence it displays the characteristic exponential be- 
havior cxp{'ybat). We stress that the Markovian evolu- 
tion is relaxing to the unique invariant state po, i-O. po 
plays the role of equilibrium state for Af^. In the non- 
Markovian case the evolution is relaxing only if /(O) = 1. 
Note, however, that even if the evolution is relaxing, re- 
laxation needs not be exponential. 

C. Entanglement 

It is clear that if e*^ describes the relaxing evolution 
of a composed system and its equilibrium state ut is sep- 
arable, then all initially entangled states asymptotically 
become disentangled. This is no longer true for non- 
Markovian evolutions, such as (|26p and ([5^ . Whether 
the asymptotic state is separable or not may depend on 
the initial state as well. If one starts at time t = with 
an entangled state p, the asymptotic state or ([55)1 
might be entangled even if lo is separable. Moreover the 
system may consists of an arbitrary number of parties. 
For example, in the simplest case of a 2-qubit system pos- 
sessing an invariant (but not equilibrium) state a; which 
is maximally mixed, i.e. w = 1/4, Eq. defines a mixed 
asymptotic state (1 — p)I/A + pp. Hence, starting with a 
maximally entangled state {ip) the dynamics (j26p asymp- 
totically approaches a Werner-like state 

i^I + p|V)(V'l, (45) 

which is entangled if p > 1/3 [1^. Hence, the "non- 
Markovianity parameter" p controls the entanglement of 
the asymptotic state. 

Similarly, using the spectral resolution I = 
IV'q)(V'q|i with \tpa) being the four Bell states, one 
finds that starting with an initial state p the non- 
Markovian dynamics ([5^ with an invariant state ui = 1/4 
asymptotically approaches the Bell-diagonal state 

^Pa|V'a)(V'a|, (46) 
a 

with Pa = (1 — p)/4 + p {ijja\p\ipa) depending upon the 
initial state p. It is well known that PS|) is entangled if 
exactly one Pa > 1/2. Again, p controls the separability 
properties of the asymptotic state (|46|) . 

Finally, consider the non-Markovian dynamics gener- 
ated by the generator (|34p , where i? is a quantum channel 



B : B{Ui®'H2) — > B{'Hx®'H2)- The simplest example 
of _B is a projection defined by 

Bp = ^PmnpPmn, (47) 

rn,n 

where P„m = \m (g) n) {m n\ = Pm®Pn are projec- 
tors onto the product vectors of the orthonormal basis 
in T-Li ®T-L2- Hence, if p is a density operator of the bi- 
partite system living in Hi 7^2, then representing p in 
the block form 

p = ^\m){n\®pmn, (48) 

m,n 

where p,„„ are operators in 3(712), one finds for the ac- 
tion of the projection B 

Bp = ^ipnn)ramPm ® P„. (49) 
m,n 

It is easy to find the solution of the non-Markovian mas- 
ter equation 

At = (^1 - ^ /(r)rfr^ 1 + ^ f{T)dTB, (50) 

where /(r) is defined via formula p5|) . The density ma- 
trix has the following behavior: the diagonal blocks read 

+ / fir)dT y^ipkkUnPk, (51) 

•^0 k 

and the off-diagonal blocks 

for m ^ n. This shows that during the evolution the off- 
diagonal blocks are scaled by the factor 1 — f{T)dT and 
eventually disappear if f{T)dT = 1. The asymptotic 
state of the bi-partite system reads 

AooP=(l-/(0))p + /(0)i?p. (53) 

The asymptotic entanglement is controlled by /(O). It is 
therefore clear that if /(O) = 1, then 

AooP = Bp, (54) 

which is separable being block-diagonal (the off-diagonal 
blocks disappear). Actually, due to formula the 
asymptotic state Bp is not only block diagonal but even 
diagonal in the \m(E>n) basis. It is, therefore, clear that 
in this case the state becomes separable in finite time and 
hence one encounters the sudden death of entanglement 
[3l . This happens in particular in the Markovian case (for 
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a Markovian evolution one has 1 — f{T)dT = e ^*). 

However, taking /(r) ~ eje '"^ one has /(O) = e, and 
hence 

AooP = (1 - e)p + e-Bp, (55) 

which shows that s can control the asymptotic entan- 
glement of Poo- Starting from an entangled p one may 
preserve entanglement forever by taking a large enough 
deviation 1 — e from Markovianity. 

IV. CONCLUSIONS 

In conclusion, we have shown that non-Markovian dy- 
namics represent a completely new kind of quantum evo- 
lution. They are much more flexible than the Marko- 
vian ones and can lead to a completely novel behavior of 
the quantum system. In general, they provoke a modi- 
fication of the characteristic exponential relaxation law 
known from Markovian evolutions. As a consequence, 
non-Markovianity entails new features of decoherence 
and relaxation to equilibrium. Interestingly, even if the 
evolution relaxes to an equilibrium state, this state need 
not be invariant. This can never happen in the Marko- 



vian case. Therefore, the non-invariance of equilibrium 
becomes a clear sign of non-Markovianity. 

We have shown the asymptotic state of the system de- 
pends on the initial conditions, even if the non-Markovian 
dynamics possesses an invariant state. For composed 
systems this implies that the asymptotic states can re- 
member (and partially preserve) its initial entanglement. 
Hence some residual entanglement can remain even in 
the remote future. Therefore, non-Markovian evolutions 
may avoid the phenomenon of sudden death of entangle- 
ment and can preserve entanglement forever. Our exam- 
ples show that the asymptotic entanglement can be con- 
trolled by some characteristic parameters of the system 
in question (we called them non-Markovianity parame- 
ters). These model-independent conclusions have been 
illustrated by several examples and seem to pave the way 
towards a more general comprehension and practical ex- 
ploitation of non Markovian evolutions. 
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